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SUMMARY 


brief  review  of  the  properties  of  sampled  signals 
is  given,  and  used  to  describe  systems  which  contain  digital 
components.  It  is  shown  that  the  errors  in  such  digital  data 
systems  are  of  two  types,  one  due  to  the  inaccuracies  in  the 
algorithm  programmed,  and  the  other  due  to  the  reconstruction 
process  necessary  to  convert  the  digital  data  to  analog  form. 
The  latter  error  only  is  discussed. 


A  number  of  realizable  smoothing  filters,  which  can 
be  used  to  improve  the  reconstruction  accuracy  over  that  obtain¬ 
able  directly  by  conventional  digital-to-analog  converters,  are 
presented.  The  frequency  responses  of  these  filters  are  compared 
with  the  ideal  recovery  filter.  Also  discussed  is  the  percent 
root  mean  square  reconstruction  error  when  these  filters  are  used 
to  recover  a  sampled  sinusoid. 

Circuits  are  presented  for  the  realization  of  these 
filters  using  standard  analog  computer  components. 
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SMOOTHING  OF  DIGITAL- TO- ANALOG  CONVERTED  DATA 
IN  DIGITAL  DATA  SYSTEMS 

1.0  INTRODUCTION 

Over  the  past  number  of  years  a  great  deal  of  interest 
has  been  shown  in  the  use  of  digital  devices  in  situations  which 
had  previously  been  the  exclusive  domain  of  continuous  or  analog 
devices.  The  two  most  evident  examples  of  this  trend  are  the 
use  of  digital  controllers  for  process  control,  and  the  invasion 
of  the  hallowed  analog  ground  of  system  simulation  by  the  digital 
computer.  This  trend  has  also  resulted  in  a  new  dimension  being 
added  to  the  fields  of  computation  and  control  by  the  combined 
use  of  analog  and  digital  devices  (hybrid  computers)  by  assigning 
to  eech  that  portion  of  the  task  to  which  it  is  best  suited.  It 
is  the  resulting  mixture  of  the  two  types  of  data  in  one  system, 
i,e.  digital  data  and  continuous  data,  that  defines  the  systems 
of  interest  here,  and  which  are  called  sampled-data  systems 
(see  Ref,  1,  2,  3,  4,  5), 

In  general,  a  sampled-data  system  is  defined  as  any 
system  in  which  there  appear  signals  which  can  be  said  to  exist 
only  at  discrete  instants  of  time.  The  interest  in  radar  systems, 
in  which  data  existed  in  the  form  of  pulses,  stimulated  the 
theoretical  study  of  sampled-data  systems  in  the  late  1940’ s, 
and  by  the  middle  1950’ s  a  sound  theory  had  been  evolved  for 
dealing  with  these  pulsed-data  systems.  As  digital  computers 
became  fast  enough  for  use  in  real  time  situations,  it  was  found 
that  sampled-data  theory  could  also  be  applied  to  the  study  of 
these  digital-data  systems  after  a  suitable  representation  of 
digital  data  was  defined. 

Section  2  discusses  this  problem  of  representation  of 
digital  data,  and  indicates  how  the  sampled-data  theory,  reviewed 
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in  Sections  3.1  to  3.3,  can  be  applied  to  the  study  of  digital- 
data  systems.  This  review  of  sampled-data  theory  also  introduces, 
in  Section  3.4,  the  data  reconstruction  problem,  which  is  the  main 
topic  of  this  report.  The  section  concludes  with  a  technique  for 
obtaining  the  digital  (or  pulse)  transfer  function  for  certain 
digital  programs  in  the  general  situation  when  initial  conditions 
may  be  present. 

Section  4  presents  an  analysis  of  the  sources  of  error 
in  digital-data  systems,  and  indicates  that  this  error  can  be 
separated  into  two  distinct  components.  The  first  component  can 
be  attributed  to  the  numerical  algorithm  programmed,  and  the 
second  component  can  be  attributed  to  errors  in  the  dlgltal-to- 
analog  reconstruction  process. 

Sections  5  and  6  present  an  analysis  of  various  realiz¬ 
able  reconstruction  devices  (filters)  that  can  be  used  in  the 
dlgltal-to-analog  recovery  process,  and  show  how  they  can  be 
constructed  from  standard  analog  computer  components.  These 
filters  are  compared  in  two  ways.  First  the  frequency  response 
characteristics  of  each  is  obtained.  In  the  majority  of  cases 
this  frequency  response  information  was  not  previously  available, 
and  in  all  cases  was  not  available  in  sufficient  detail  so  that 
the  comparisons  of  Section  7  could  be  made. 

Section  8  presents  a  new  comparison  between  the  various 
filters,  which  is  the  root  mean  square  recovery  error  when  the 
filters  receive  a  sampled  sinusoid  of  a  given  frequency.  This 
comparison  is  in  a  form  which  allows  otherwise  difficult  design 
decisions  to  be  made  quite  easily  in  situations  where  the  root 
mean  square  error  is  a  suitable  error  measure. 

2.0  DIGITAL  DATA  SYSTEMS 

A  digital  data  system  is  here  used  to  define  a  system 
in  which  signals  that  are  number  sequences  appear.  One  can 
think  of  the  signal  as  being  that  sequence  of  numbers  that 
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appear  at  a  given  location  in  the  digital  device;  the  time 
history  of  the  contents  of  this  location  define  aj, number  ^ 

sequence  which  is  related  to  the  other  number  sequences  at 
the  other  locations  in  the  device.  ,  ^  , 

Consider  only  those  situations,  illustrated  in 
Figure  l(a),  where  the  digital  portion  of  the  system  is  operating 
in  real  time;  that  is,  there  exists  an  "input”  number  sequence 
to  the  program,  which  is  derived  from  some  external  real 

time  signal,  r( t). ,  by  a  sampling  process.  The  purpose  of  the  * 
program  is  to  cause  an  output  time  signal,  c(t),  which  is  derived 
from  the  program  "output"  number  sequence,  when  it  is  passed 

through  suitable  converters. 

If  the  input  sequence,  {r^J,  ife  derived  from  the  input 
signal,  r(t),  there  must  be  some  data  transducer  to  translate 
the  input  signal  (voltage,  current,  force,  etc.)  to  the  numerical 
(coded)  language  of  the  digital  computer.  This  data  translation 
is  done  by  some  form  of  analog-to-digital  conversio.i.  This  con¬ 
version  may  be  the  manual  reading  of  dials  and  the  subsequent 
entering  of  corresponding  numbers  by  cards  or  on  the  computer 
typewriter,  or  may  be  a  completely  automatic,  electronic  analog- 
digital  converter  operated  under  program  control. 

Similarly  some  form  of  digital-to-analog  conversion 
is  required  to  generate  the  output,  c(t),  from  the  sequence  (c^). 

Another  property  of  digital  devices  which  is  of  concern 
here  is  the  existence  of  computation  time.  The  digital  computer 
is  basically  a  serial  device;  that  is,  all  operations  performed 
by  it  must  be  programmed  as  a  sequence  of  simple  steps,  and, 
although  each  step  is  performed  very  quickly,  the  whole  computa¬ 
tion  may  take  an  appreciable  time.  Since  the  inputing  of  r(t) 
information  and  the  outputing  of  the  latest  value  of  {c^}  are 
steps  in  this  program,  the  input  and  output  sequences  can  only 
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be  samples  of  their  respective  continuous  signals,  and  no 
information  about  their  behaviour  is  available  between  these 
sample  times.  Obviously  the  highest  sampling  rates  obtainable 
will  depend  on  the  complexity  of  the  program  itself. 

Now  the  input  sequence  can  completely  characterize 
the  signal  r(t),  (provided  round-off  errors  are  not  significant) 
if  the  sampling  theorem,  discussed  in  Section  3.3,  is  satisfied. 
The  output  time  signal  will,  in  general,  correspond  to  the  out¬ 
put  sequence  at  the  sample  times  (i.e.  at  the  instant  of  a 
digital-to-analog  conversion),  and  it  must  be  the  task  of  the 
conversion  process  to  generate  an  intersample  signal  to  yield 
an  acceptable  continuous  output  signal  c(t).  This  generation 
of  a  continuous  output  from  the  output  sequence  is  the  topic 
of  this  report. 

Consider,  now,  the  problem  of  representation  of  number 
sequences.  In  the  digital  computer,  the  computation  yielding  the 
output  sequence,  from  the  input  sequence,  can  usually 

be  described  by  means  of  difference  equations.  Outside  the 
computer,  however,  the  r(t)  and  c(t)  signals  are  best  described 
by  means  of  Laplace  transform  theory.  There  is  an  obvious  need 
in  these  sampled-data  systems  for  a  complete  description  based 
entirely  on  one  mathematical  discipline.  It  is  here  that  the 
concept  of  the  impulse  function  is  of  service. 

Consider  first  the  representation  of  the  data  as  it 
passes  through  the  analog-to-digital  converter  at  the  input. 

This  converter  must  perform  two  distinct  functions;  it  must 
first  sample  the  input  signal,  r(t),  and  it  must  then  convert 
this  sampled  value  to  a  digital  number.  Let  these  two  functions 
be  represented  separately  as  shown  in  Figure  1(b),  where  the 
starred  notation,  r*(t),  represents  a  sampled  signal,  and  where 
the  symbol  for  a  periodically-operated  switch  is  introduced. 
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Assume  that  the  sampling  switch  has  the  following 
properties* 

(a)  it  operates  periodically,  with  period  T  seconds 

(b)  it  remains  closed,  at  the  sample  times,  for  an 
infinitely  short  time 

(c)  it  has  as  an  output  an  impulse  of  area  equal  to  the 
value  of  the  input  at  the  sample  instant. 

That  is, 

r*(t)  =  0  for  t  /  nT  for  integers  n 
=  00  at  t  =  nT 

such  that 

nT+e 

r*(t)dt  =  r(nT) 

u 

nT-e 

Applying  similar  arguments  to  the  digital-analog 
converter  of  the  output,  there  results  an  equivalent  descrip¬ 
tion  of  the  digital  data  system  of  Figure  l(a),  by  that  shown 
in  Figure  1 (c) . 

This  figure  suggests  that,  since  the  data  trans¬ 
ducers  of  the  input  and  output  are  unity  gain  devices,  the 
digital  program  can  be  described  as  that  portion  of  the  system 
which  receives  a  sampled  signal  input,  r*(t),  and  produces  a 
sampled  signal  output,  c*(t).  Since  the  Laplace  transforms  of 
these  sampled  signals  exist,  the  program  can  now  be  described 
as  the  ratio  of  these  Laplace  transforms,  yielding  a  Laplace 
transfer  function  for  the  program,  or  a  digital  transfer  func¬ 
tion.  Thus  the  digital-data  system  can  be  described  as  shown 
in  Figure  l(d),  where  H(s)  is  the  digital  transfer  function,  and 
the  output  sampler  emphasizes  that  c*{t)  is  a  sampled  signal. 
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By  the  use  of  this  digital  transfer  function  for  the 
digital  program,  the  complete  description  of  a  digital-data 
system  can  be  based  on  Laplace  transform  theory. 

3.0  THE  SAMPLING  PRXESS 
3.1  The  Ideal  Sampler 

It  can  be  seen,  with  reference  to  Figure  1(c),  that 
the  Laplace  transform  description  of  digital-data  systems  can 
proceed  based  on  the  concept  of  an  ideal  sampling  switch.  To 
describe  this  ideal  sampling  switch  in  detail,  consider  the 
replacement  of  this  switch  by  the  amplitude  modulator  of 
Figure  2(a)  (Ref.  1,  p.  18). 

Let  the  carrier  be  an  impulse  train  6j(t)  where 

oo 

6T(t)  =  6(t-nT) 

n=0 


and  where  6(t)  is  a  unit  impulse  at  t  =  0.  The  output  of  the 
modulator  is  defined  as  the  product 

r*(t)  =  6^(t)  •  r(t) 

and  it  is  seen  that  r  (t)  becomes  a  sequence  of  impulses  of 
area  equal  to  the  value  of  r(t)  at  the  positions  of  these 
impulses,  as  required. 
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Since  6j(t)  =  0  for  t  i  nT,  then 

00 

r*(t)  =  [  ^  6{t-nT)]  •  r(t) 
•  n=0 


00 

^  r(t)  •  6(t-nT) 
n=0 


00 

-  r(nT)6(t-nT)  (l) 

n=0 

and  the  character  of  r  (t)  is  exhibited. 

Taking  the  Laplace  transform  of  this  sampled  signal 

oo  oo 

R  (s)  =  L{r*(t)}  ■-  ^  r(nT)  J  6 (t-nT)e"^^dt 

n=0  0 

00 

R*(s)  =  r(nT)e'®"^  (2) 

n=0 

*K' 

Thus,  given  r(t),  the  Laplace  transform  of  r  (t)  can 
be  obtained. 

The  so-called  z-transform  description  of  sampled 


Page  -  8 
MK-12 


signals  is  obtained  by  introducing  the  notation 


(3) 


then 


(4) 


Several  tables  exist  (eg.  Ref.  3,  p.  56)  which  give 
the  z-transform  for  the  commonly  occurring  r(t)  functions,  or 
it  can  be  evaluated  directly  from  the  above  definition. 


Returning  to  the  expression  for  the  sampled  signal 
r  (t),  one  can  evaluate  the  Laplace  transform  of  this  signal 
directly  by  noting  that  the  product  of  two  time  functions  is 
equivalent  to  the  complex  convolution  of  their  respective 
transforms  (Ref.  6,  p.  275),  thus 


c+  jCX) 

R*(s)  =  L{r*(t)]  =  L{r(t)  •  .^(t)}  =  ^  R(p)  A^(s-p)dp. 

c-joo 


Carrying  out  the  indicated  operation  (Ref.  1, 
pp.  32-35),  there  results: 

oo  . 

R*(s)  =  i  I  (5) 

kr:  -  CO 

This  expression  exhibits  a  most  important  property 
of  sampled  signals,  that  is,  the  creation  of  an  infinite  number 
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of  sidebands  of  the  shape  of  the  otlginal  signal  spectrum, 

R(ja)),  these  sidebands. being  centred  at  o)  =  k  for  k  =  ±  1, 

±  2,  ±  3,  etc.  This  is  illustrated  in  Figure  2(b). 

3.3  The  Sampling  Theorem 

The  Shannon  sampling  theorem  (Ref.  1,  p.  27)  can  be 
seen  directly  from  Figure  2(b)  by  noting  that  the  sidebands  of 
a  sampled  signal,  in.  this  case  r  (t),  will  not  interact  if 
R(jco)  =  0  for  all  to  >  tt/T.  If  these  sidebands  are  non-interact- 
ing,  then  R(jto)  can  be  recovered  from  R  (jto)  by  an  ideal  low 
pass  filter  of  bandwidth  tt/T, 

The  condition  for  non-interaction  is  that  the  highest 
non-zero  signal  component,  of  frequency  to,  be  such  that 

to  ^  TT/T 

Ott 

or  ~:r  ^  where  t  is  the  period  of  this  component 

w 

thus  T  ^  (t/2)  (6) 

Thus,  if  at  least  two  samples  per  cycle  of  this 
highest  frequency  component  are  obtained,  then  r(t)  is  re- 
coverable  from  r  (t)  by  linear  filtering.  Equation  (6)  is  the 
form  in  which  the  sampling  theorem  is  usually  stated. 

Notice  that  the  signal  being  sampled,  r(t),  must 
contain  no  higher  frequency  components  than  that  allowed  by 
the  sampling  theorem.  In  particular,  it  must  not  contain  any 
high  frequency  noise  components,  which,  after  the  sampling, 
could  introduce  a  low  frequency  noise  due  to  the  sideband  effect 
(an  effect  known  as  aliasing).  This  emphasizes  the  fact  that, 
in  the  sampling  of  noisy  signals,  some  form  of  presample  filter¬ 
ing  is  desirable  (Ref.  7  and  8). 
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3.4  The  Data  Reconstruction  Task 

Again,  the  problem  is  evident  from  Figure  2(b).  If 
the  sampling  theorem  is  satisfied,* then  the  signal  is  recover¬ 
able  from  its  samples  by  means  of  an  ideal  low  pass  filter, 
with  characteristics  as  shown  in  Figure  3. 


It  is  know,  however,  that  this  ideal  recovery  filter 
is  non-realizable  since  the  impulse  response  is  non-zero  for 
t  <  0,  and  one  is  faced  with  the  problem  of  approximating  this 
ideal  filter  with  some  realizable  filter. 

This  approximation  problem  is  discussed  in  Sections 
5  to  9,  and  is  the  main  topic  of  this  report. 


3.5  Digital  (or  Pulse)  Transfer  Functions 

One  more  point  deserves  attention  here,  and  this 
is  the  evaluation  of  the  Laplace  transfer  function  H{s)  of  a 
class  of  linear  digital  programs  (see  also  Ref.  2,  pp.  70-72.). 


In  such  programs  the  current  member  of  the  output 
sequence,  c^,  is  a  linear  combination  of  current  and  past 
values  of  the  input,  and  past  values  of  the  output,  i.e., 


c  = 
n 


a  r  + 
0  n 


®mVm  ■  .h‘^n-1  '  ‘’2‘^n-2  '  * •*' ‘’k'^n-k 


rn  k 

=  y  a.r  .  -  y  b.c  . 

u  1  n-i  L  j  n-k 

i=0  j=l 


(7) 
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The  sampled  signal  representation  of  the  output  will 
be 

00  m 

c*(t)  =  I  c^6(t-nT)=  I  {)]  air^.iMt-nT) 
n=o  n=0  i=0 

-  I  b.c„.,6(t-nT)} 
j=l 

=  i  ’i  E  -  E  ‘’j  E  Vk'-tt-nT) 

i=0  n=0  j=l 

Taking  the  Laplace  transform,  and  introducing  the 
z-transform  notation, 


m 


C(z)  -  l[c 


i=0 


00 

E 

n=0 


r  .  z 
n-i 


-n 


(8) 
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Consider 

m  00 

w  =  Z  I 

i=0  n=0 


m  /V 


m 


m 


where  R(z)  is  the  z-transform  of  the  input  r  (t). 


Assume  r^  =  0  for  n  <  0,  i.e.  zero  initial  conditions, 


then 


=  ^  a^z"^R(z), 


and  equation  (s)  reduces  to 


C(z)  =  R(z)  [  a.z'-^  -  C(z)  ^  bjZ'J 

i=0  j=l 
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The  z-transforn  relating  the  Input  and  output, ^equencest 

is  thus 


H{z) 


R(z) 


H(s) 


s=l/T  In  z 


(10) 


This  is  known  as  the  digital  (or  pulse)  transfer 
function  of  the  program  defined  by  the  difference  equation  (7). 

In  the  situation  where  the  initial  values 
r  for  n  =  -i  to  -1 


and 


c  for  n  =  “j  to  -1 
n 


are  not  zero,  the  digital  transfer  function  becomes,  from 
equation  (8) 

h(z)  -  C(z) 

'  '  R(z) 

m  mi  kj  /.o\^ 

E  E  •.(  E -  E^iCE"-.--'-*’) 


i=0 


i=0  ^  1 


1=0 


^  b.z 

j=l 


-J 


^  b.z 
j=l 


-J 


(11) 


where  the  second  term  contains  the  effect  of  these  non-zero 
initial  values. 
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4.0  ERRORS  IN  DIGITAL  DATA  SYSTEMS 

Before  proceeding  with-  the  discussion  of  realizable 
reconstruction  devices  for  digital  data  systems,  it  is  of  interest 
to  separate  the  reconstruction  errors  from  other  possible  errors 
in  the  system.  To  this  end,  consider  the  system  design  problem 
illustrated  in  Figure  4(a).  The  system  receives  an  input  r(t), 
produces  an  output  c(t)  which  can  be  compared  with  a  desired 
output  d(t),  the  result  of  some  ideal  operation  which  also 
receives  r(t)  as  an  input. 

This  difference  between  the  desired  output  d(t)  and 
the  actual  output  c(t)  defines  the  system  error  e(t).  The  problem 
of  specifying  separately  the  digital  program  and  the  data  re¬ 
construction  device  can  be  done  only  after  their  separate  func¬ 
tions  have  been  defined,  for  the  over-all  system  design  is 
defined  quite  independently  of  these  separate  functions.  Indeed 
this  separation  of  the  individual  functions  of  the  two  devices 
becomes  necessary  only  in  order  to  reduce  the  problem  to  a 
manageable  form. 

The  most  likely  function  for  the  digital  program 
would  be  that  it  attempts  to  produce,  at  the  sample  instants, 
samples  of  the  ideal  output  d(t),  as  shown  in  Figure  4(b).  One 
can  then  define  a  sampled  digital  program  error,  (t),  as  the 
difference  between  the  samples  of  the  ideal  output,  d  (t),  and 
the  program  output 


s/(t)  =  /(t)  -  c*(t)  (12) 

c*(t)  =  d*(t)  -  e/(t) 


or 


(13) 
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Let  this  digital  error,  (t),  be  a  sample  of  some 
continuous  digital  program  error  signal,  where,  from  (12), 

e^{t)  =  d(t)  -  Cj(t)  (14) 

where  Cj(t)  is  the  ideal  recovery  of  the  sampled  signal  c  (t). 
Figure  4(a)  can  now  be  visualized  as  Figure  4(c). 

The  function  of  the  data  reconstruction  device  is 
now  defined  as  that  of  attempting  the  ideal  recovery  of  the 
sampled  signal  it  receives.  The  ideal  recovery  of  c  (t)  was 
defined  as  Cj(t),  and  a  reconstruction  error,  e  (t),  can  be 
defined  as; 

^c^t)  =  Cj(t)  -  c(t)  (15) 

or  c(t)  =  Cj(t)  +  (16) 

The  system  now  becomes  as  shown  in  Figure  4(d). 

Since  the  operations  of  sampling,  followed  by  ideal 
recovery,  result  in  the  recovery  of  the  original  signal,  these 
operations  cancel,  and  the  total  system  error  becomes; 

e(t)  =  e^(t)  +  e^(t)  (17) 


where,  to  repeat, 

e^(t)  =  digital  error,  the  ideal  recovery  of  the  sampled 
signal  which  is  the  difference  between  the  ideal 
output  at  the  sample  times,  and  the  computed 
values  at  these  same  instants. 
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^-(t)  =  reconstruction  error,  the  difference  between  the 
c 

ideal  recovery  of  the  digital  output,  and  the 
actual  output. 

This  report  will  now  discuss  the  reconstruction  error, 

E  (t),  for  realizable  reconstruction  filters.  The  problem  of  the 
c 

digital  error,  e^(t),  is  considered  elsewhere  (Ref.  9). 

5.0  POLYNOMIAL  RECONSTRUCTION  FILTERS 

It  was  seen  in  Section  3.4  and  Figure  3  that  the 
ideal  reconstruction  filter  has  the  ideal  low-pass  characteristics 
and  so  is  non-realizable.  One  is  led  to  compare  realizable  filters 
with  this  ideal.  A  class  of  realizable  filters  are  the  polynomial 
filters  described  by  means  of  Figure  5. 

Let  the  reconstruction  filter  output,  c(t),  be  given 
as  an  N^^-degree  polynomial,  such  that 


N 

1=0 


for  nT  ^  t  <  (rt<-l)T  (18) 

The  current  values  of  the  coefficients  a.  for  i  =  0,  1,  2,  ....  N 

1 ,  n 

will  be  obtained  by  use  of  past  values  of  the  output,  i.e., 

“i,n  ""  *^11-1’  '^n-2’  -  ‘^n-N^ 

In  this  discussion  we  will  distinguish  among  three 
types  of  polynomial  filters,  the  EXTFIAPOLATING  filter,  the 
SMOOTHED  EXTRAPOLATING  filter,  and  the  DELAYED  filter. 
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*  t 

Consider  first  the  extrapolating  filter.  At  the  time 
t  =  riT,  the  most  recent  value  of  available  is  c^,  and  let  , . 
the  output  then  start  at  this  value. 

i.e. ,  c(t)  =  at  t  =  nT 

Now  let  c(t)  be  an  N^^-degree  polynomial  which  also 
passes  through  the  most  recent  N  values  of  c^» 


i.e., 

c(t)  =  c^_^  at 

t  = 

(n-l)T 

^n-2 

• 

• 

t  = 

(n-2)T 

• 

=  c  at 

n-N 

t  = 

(n-N)T 

Thus,  this  filter  is  seen  to  generate  an  intersample 

sig.ial  which  is  such  as  to  predict,  with  an  N^*^-order  prediction 

the  value  of  c_^i.  At  the  time  t  =  (n+l)T  when  c  .  ,  becomes 
rH- 1  rr+-  i 

available,  it  will,  in  general,  differ  from  the  predicted  value, 
and  so  c(t)  will  have  discontinuities  at  the  sample  times. 

The  smoothed  extrapolating  filter  is  a  logical  exten¬ 
sion  of  the  extrapolating  filter  which  does  not  allow  dis¬ 
continuities  in  the  output  at  t  =  nT  to  appear,  but  applies 
the  required  correction  linearly  over  the  next  sample  interval, 
i.e.  in  the  interval  nT  ^  t  <  (n+l)T. 

Another  means  of  overcoming  the  discontinuity  in  the 
extrapolating  filter  output  is  to  generate  a  signal  which  passes 
through  c^  only  at  a  time  t  -  (n+l)T.  In  other  words,  wait  one 
sample  interval  until  the  end  point  of  the  intersample  signal 
IS  known,  then  generate  it  by  M  -order  interpolation.  This 
defines  the  delayed  filter. 
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In  the  sections  that  follow  various  polynomial  filters 
are  discussed,  their  frequency  responses  are  given,  and  circuits 
for  their  realization  using  standard  analog  computer  components 
are  given. 

5.1  Zero-Order  Filter  (Clamp  or  Zerc~Order  Hold) 

A  very  common  polynomial  filter  is  the  zero-order 
filter,  where  the  most  recent  value  of  the  output  sequence  is 
converted  to  a  level  which  is  held  throughout  the  intersample 
period,  i.e.. 


for 


nT  £  t  <  (nvl)T 


The  operation  of  this  clamp  recovery  filter  is  illustrated  in 
Figure  6(a). 

The  unit  sample  or  impulse  response  is  seen  to  be 
h^Ct)  =1,  0  ^  t  <  T 

=  0  otherwise 


Taking  the  Laplace  transform  of  this  impulse  response 
results  in  the  transfer  function  of  this  filter,  i.e.. 


The  frequency  response  Figure  6(c)  of  this  first- 
order  hold  is  obtained  by  substituting  s  =  jco,  to  yield 


|H  (ja))|  = 
o  '  0) 


_  27r  sin  x 


X 


(20) 

cont’d 
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and  AtJ'")  =  -  (20) 

^ ^ -  |sln  xl 

where  x  = 

and  where  Y  is  the  number  of  samples  per  cycle  of  the  input  of 
frequency  co  rad. /sec. 

In  digital-data  systems,  the  usefulness  of  the  zero- 

order  hold  (or  clamp  or  filter)  results  from  the  fact  that  most, 

if  not  all,  commercial  digital-analog  converters  convert  the 

digital  sequence  (c^j  to  a  voltage  level  which  is,  in  fact, 

held  throughout  the  succeeding  interval,  i.e.,  includes  a  zero- 

order  filter.  Thus  any  reconstruction  filter  of  interest  must 

include  the  H  (s)  transfer  function  as  one  of  its  factors. 

0 

Often  the  zero-order  recovery  is  of  sufficient  accuracy  that 
its  output  can  be  used  directly. 

It  is  also  possible  to  realize  another  form  of  a 
zero-order  filter  with  a  conventional  analog  computer  integrator, 
as  shown  in  Figure  6(b). 

The  input  is  applied  to  the  initial  condition  input 
of  an  integrator  which  is  periodically  put  into  the  reset  mode 
for  a  short  time  at  the  sample  instants,  remaining  on  "hold"  or 
"operate"  between  these  sample  times.  The  time  during  which 
the  integrator  must  be  in  the  reset  mode  is,  for  conventional 
analog  computer  components,  a  function  of  the  time  constant 
formed  by  the  integrating  capacitor  and  initial  condition 
resistors.  In  many  modern  analog  computers,  this  reset  time 
is  reduced  to  negligible  amounts  by  special  design  (see  Ref. 

10). 
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5.2  First-Order  Filters 

5.2.1  First-Order  Extrapolator  -  Unsmoothed 

The  first-order  extrapolating  filter,  or  first-order 
hold,  has  an  output  given  by 

c(t)  =  (c^  -  (t  -  nT)  + 

for  nT^t<(n+l)T 

This  is  illustrated  in  Figure  7(a). 

At  the  time  nT,  the  slope  of  c(t)  is  assumed  constant 
and  given  by 


and  a  linear  extrapolation  of  a  signal  of  this  slope  is  generated 
which  starts  at  c^.  The  impulse  response  is  illustrated  in 
Figure  7(b). 

Thus , 

hj(t)  =  (l+t/T)u(t)  -  2u(t-T)  -  2u(t-T) 

+  u(t-2T)  +  u(t-2T) 
where  u(t)  is  a  unit  step  at  t  =  0. 


hj^(t)  =  (l+t/T)u(t)  -  2  (l  +  +  0  u(t-2T) 


Now 
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I 


L(f(t-T)}  =  e"'®  F(s)  ■  if  f(t-T)  =  0  for  t  <  T 
Thus  the  Laplace  transform  of  this  filter  is 

H^(s)  =  Q  +  (l  -  2e-'f®  +  e-2T®) 

^  Ts 

-Ts  ^ 

=  (s  +  1/T)  (}-^ - ')  (21) 

The  frequency  response,  Figure  7(c),  is  given  by 


|Hi(jco)|  =  ^  [— i\/l  + 
s 


and 


/  ( jo))  =  -2x  +  tan 


(2x) 


(22) 


where  x  =  —  as  before. 

In  order  to  realize  this  first-order  filter,  using 
analog  computing  components,  consider 


=  0^  ??)(- 


) 


Now  this  transfer  function  is  seen  to  be  the  response 
of  a  circuit  which  has  an  input 

Us)  =  (1  -  e-T=) 
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followed  by  a  zero-order  hold 

■  ' 

followeo  by  a  circuit  which  has  the  transfer  function 

O-i) 

This  is  shown  in  Figure  7(d). 

The  problem  now  is  to  generate  a  signal  which  has 
the  transform  e"^^. 

Consider  the  output  of  the  integrator,  x(t),  then 

XI.)  = 

=  (1  .  .-'•)'  (-Ij) 

The  sampled  value  of  this  signal  has  the  transform  (Ref.  1, 
Appendix  A,  where  z  =  e° j 


X’ 


(s)  = 


{1 


e 


-Ts 


Thus  the  samples  of  x(t) 
Moving  the  zero-order  hold  outside 
for  analog  computer  component  sign 
cuit  is  shown  in  Figure  7(e). 


are  our  required  signal, 
the  loop,  and  accounting 
changes,  the  complete  cir- 
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5.2.2  First-Order  Extrapolator  -  Smoothed 

It  is  seen,  from  Figure  7(a),  that  the  first-order 
filter  has  discontinuities  at  the  sample  instants  due  to  the 
difference  between  the  first-order  prediction  of  the  next  out¬ 
put  sample,  and  the  actual  value  of  this  sample.  One  can  avoid 
this  by  applying  this  correction  linearly  over  the  succeeding 
sample  interval  as  shown  in  Figure  8(a). 

c(t)  =  +  (t-nT)  +  (l  -  [t-nl])  (c/^-c^) 


for 


nT  ^  t  <  (rH-l)T 


where  the  primed  values  are  the  first-order  predictions  of  the 
output  sequence  values, 


1 .  e. 


1  =  (c  -c  1 )  +  c 
n+1  n  n-1  n 


I 

c 

n 


n-2 


)  + 


c 

n 


1 


Thus , 


c(t)  =  +  (t-nT)  (c^-c^_j^)  +  (1  -  [t-nT])  (2c^_^-c^_2-c^) 

for  nT  ^  t  <  (n+l)T 

The  impulse  response  of  the  circuit  with  the  required 
properties  is  shown  in  Figure  8(b),  together  with  the  unsmoothed 
case  for  comparison. 
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Thus, 

hj_^(t)  =  2u(t)  (t/T)  -  5u(t-T)  4u{t-2T) 

-  u(t-3T) 
and 


(s) 


To  realize  this  first-order  smoothed  filter,  we  again 
recognize  the  clamp  and  integrator,  and  require  to  obtain  an 
input 

^{s)  =  (2  -  3e-=T  ^  e-2=T) 

=  1  +  (1  -  3e"^^  + 
as  shown  in  Figure  8(d). 
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/ 


The  integrator  output  is 
X(s)  =  Us)  H^,(s)  (^) 


*  /  , 
X  (s) 


(2  -  3e‘®^  +  (1  -  e"®’'')  (-^ 

Ts"^ 

The  sampled  value  of  this  output  has  the  transform 
(2  -  3e-®^  .  e-2=t)  (1  -  (i) 

(1  -  e-®T; 


=  e-®'’'  (2  -  e-®T) 

Thus  the  circuit  of  Figure  8(d)  becomes  Figure  8(e). 

The  additive  signal  at  the  input  is  recognized  as 
being  the  ^(s)  signal  for  the  unsmoothed  first-order  case,  and 
Figure  8(f)  results. 

5.2.3  First-Order  Interpolator  -  Delayed 

Another  means  of  overcoming  the  discontinuities  of 
the  first-order  extrapolator  is  to  allow  for  a  delay  of  one 
sample  interval,  at  which  time  a  linear  interpolation  can  be 
performed.  This  is  illustrated  in  Figure  9(a). 

The  output  is  given  by 


n-1 


c(t)  -  (c^-c^_.j^)  (t-nT)  +  c 
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The  impulse  response  shown  in  Figure  9(b)  is 


=  u(t)  t/T  -  2u(t-T)  (^)+  u(t-2T) 


Thus  the  transform  is 


■  i  0-^ 


-Ts  ^  .-2Ts 


(24) 


The  frequency  response,  Figure  9(c),  is  given  by 


H,  Jja))l  =  ^ 

1,0  L  X 


A.d<J“)  =  - 


Again,  in  order  to  realize  this  filter,  write  the 
transfer  function  in  the  form 


=  (- 


-  e 


-T 


^  (’ 


1  -  e 


)(A) 


The  zero-order  hold  (clamp)  and  integrator  are  re¬ 
cognized,  as  is  the  ^(s)  signal,  as  being  the  same  as  the 
extrapolated  case.  The  final  realization  is  shown  in  Figure 
9(d). 
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5.2.4  First-Order  Extrapolator  -  Ideal, 

As  a  measure  of  the  limit  of  accuracy  for  linear 
approximations  in  the  intersample  interval,  consider  the  ideal 
linear  case  when,  at  the  time  t  =  nT,  the  value  of  c^^j^  is  known, 
and  the  straight  line  approximation  between  sample  values  can  be 
generated.  This  would  be  the  case,  for  example,  when  a  known 
function  is  being  outputted  from  the  digital  computer,  and  the 
value  c^j^  can  be  outputted  at  the  time  t  =  nT.  Another  realiza¬ 
tion  of  this  ideal  case  is  in  the  strict  data  conversion  task, 
when  a  time  delay  in  the  recovery  process  is  of  no  consequence, 
and  a  time  shift  in  the  output  time  axis  of  one  sample  interval 
is  allowed. 


This  ideal  linear  case  is  illustrated  in  Figure  10. 

The  situation  is  essentially  no  different  from  the 
first-order  delayed  case,  and,  introducing  a  time  advance  of 
T  seconds,  the  transfer  function  becomes 


H,  j(s)  =  e 


Ts 


(25) 


This  is  seen  to  be  identical  with  the  first-order 
delayed  extrapolator  in  amplitude,  but  without  the  phase  shift, 
and  the  frequency  response  is  also  given  in  Figure  9(c). 

The  realization,  allowing  for  the  dealy  in  the  out¬ 
put,  or  the  presence  of  at  time  t  =  nT,  is  the  same  as  in 

Figure  9(d). 
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5.3  Second-Order  Filters 

5.3.1  Second-Order  Extrapolating  Filter  -  Unsmoothed 

Let  the  intersample  signal  be  a  second-order  func¬ 
tion  of  the  form 

c(t)  =  0^(t-nT)2  +  Pj,(t-nT)  + 


for 


nT  ^  t  <  (n+1) 


Thus , 


The  coefficients  will  be  chosen  such  that 


c(t)  =  Cj^  at  t  =  nT 


^n-1  “  (n-l)T 


c  o  at  t  =  (n-2)T 
n-z 


c  =  6 
n  n 


c  1  =  ct  -  0  +6 

n-1  n  ^n  n 


c  o  =  4a  -  26  +6 

n-2  n  n 


a  = 
n 


c„  -  2c  1  +  c  o 
n  n-1  n-2 


3c  -  4c  1  +  c  o 
Q  _  n  n-1  n-2 

^n  2 


6  =  c 

n  n 


Solving  gives 
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Thus, 

c(t)  =  (-2 - (t-nT)2  +  (—2 - J.-^)  (t-nT)  + 

for  nT  S  t  <  (n+l)T 

The  impulse  response  shown  in  Figure  11(a)  is 

=  „(,)  [It/T)"*  3H/l).Zj  .  [(t/l)^»3[t/T).2j 

-  -k-t)  [(tr)^  2 (l^r)]..,..2T)[(1^0'-  2 frO] 


which  can  be  written  in  the  form 

h2(t)  =  ^  [(i)^  <i>  2]  -  3/4  u(t-T)  3(i^  +  2 

+  3/4  u(t-2T)  [(—^^  +  3  “] 

-  1/4  u(t-3T)  [(ifT)^  .  3  (i^  .  2j 
Taking  the  Laplace  transform 


29 


(26) 
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The  frequency  response,  Figure  11(b),  is  given  by' 


As  before,  we  split  H2(s)  into  recognizable  factors 


which  is  realizable  in  the  form  suggested  by  Figure  11(c). 
Consider  the  signal 
e(t)  =  ax(t)  +  py(t) 

and  enquire  if  there  exist  values  of  a  and  p  such  that 

p*/  \  _  o  “ST  ”2sT 
t  (s)  =  -  2e  +  e 

Now 

x(s)  -  d  .  V  (i-x-££)  (i) 

x*|.)  .  II  .  .-')"  •  i  ■  [-^] 

(1  - 

=  (1  - 


•  • 
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Similarly, 

„  -sT  /,  . 

Y*(s)  =  ^ ^ 

2 

.*.  E*(s)  =  ae”'*^  (l  -  e  +  pe  (l  +  e 


-2sT 

e 


Solving,  a  =  -1,  P  =  -3/2. 

Thus  the  filter  can  be  realized  as  shown  in  Figure  11(d) 

5.3.2  Second-Order  -  Unit  Delay 

Again,  the  presence  of  the  discontinuities  at  the 
sample  instants  can  be  avoided  at  the  expense  of  adding  a  delay. 
In  this  case  we  get 


where 


II 

o 

+ 

V  2 

-> 

T  - 

(t  - 

nT) 

It  is 

seen 

that 

c(t)  = 

c 

n 

at 

1 — 1 

II 

P 

= 

^n-1 

at 

T  =  0; 

^n-2 

at 

1 — 1 

II 

p 

t  =  (n+l)T 
t  =  nT 
=  (n-l)T 
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The  impulse  response  is  shown  in  Figure  12(a), 
and 

h2^,(t)  -  [(t/T)2  .  [(t/T)2  .  t/T] 

or 

=  [(t/T)2  +  (t/T)]  -  3/2  [(i^^  +  (^^]  u(t-T) 

+  3/2  +  (■^^] 

.  1/2  [(tz|I)'  .  (t^J  u(t-3T) 


Taking  the  Laplace  transform, 


(27) 
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The  frequency  response,  Figure  12(b),  is  given  by 
|u  (jco)l  =  2irisi!L)dj3^^Y-pY 

j(Ja))  =  3x  +  tan"^  x 

" '  -  |sin  x| 

The  filter  can  be  realized  by  considering 


(s) 


(1  -  2e‘^®  + 


which  is  shown  in  final  form  in  Figure  12(c). 

b.3.3  Second-Order  Extrapolator  -  Ideal 

Again,  as  in  Section  5.2.4,  one  can  conside'  the  re¬ 
covery  when  delay  is  of  no  consequence,  or  when  c^j^  is  known 
at  time  nT.  The  transfer  function  is  obviously 

H2^i(s)  =  H2^^(s)  •  e^"^ 

■  •  #1 

and  is  realized  using  Figure  12(c). 

Forming  the  frequency  response,  the  amplitude  is  the 
same  as  for  the  unit  delay  case  (Fig.  12(b))  but  with  the  phase 
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given  by 


X 


sin  X  ^ 
sin  X 


which  is  included  in  Figure  12(b). 

5.4  General  N^^>Order  Filters 

The  realization  of  the  discussed  extrapolators ,  and, 
when  delays  are  allowed,  interpolators,  with  analog  computer 
components  suggests  that,  in  general,  any  polynomial  filter 
can  be  realized  in  this  way.  This  has  been  proved  in  general 
(Ref.  11),  where  the  general  -order  filter,  with  or  without 
delay,  will  have  the  form  show  in  Figure  13.  The  and 
are  positive  or  negative. 


6.0  OTHER  RECONSTRUCTION  FILTERS 

Needless  to  say,  the  class  of  polynomial  filters 
discussed  in  the  previous  section  are  by  no  means  the  only  type 
of  realizable  filters  deserving  of  attention,  although  it  will 
be  seen  that,  in  most  cases,  they  provide  the  best  performance 
foi  a  given  complexity.  Two  additional  types  are  discussed 
here,  the  fractional-order  hold,  and  first-  and  second-degree 
exponential  types  of  filters. 

6.1  The  Fractional-Order  Hold 

For  reasons  which  are  apparent  when  the  frequency 
response  of  the  zero-  and  first-order  polynomial  filters  are 
compared,  a  seemingly  more  satisfactory  frequency  response  is 
obtained  by  a  filter  which  is  a  compromise  between  the  two. 
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For  such  a  filter,  let  the  output  be  given  by 


c(t)  =  (t  -  nT)  + 


nT  ^  t  <  (n+l)T 


and  where 


0  ^  k  ^  1 


When  k  =  0,  the  filter  becomes  a  zero-order  filter, 
and  when  k  =  1  it  becomes  a  first-order  filter.  Such  a  filter, 
for  arbitrary  k,  is  known  as  the  fractional-order  filter  (or 
hold)  (Ref.  1,  pp.  49-51). 

The  impulse  response  is  shown  in  Figure  14(a),  and 
shows  how  the  overshoot  of  the  first-order  filter  is  decreased 
by  allowing  k  to  be  less  than  1. 

The  impulse  response  is  given  by 


h|^(t)  =  u(t)  [l  +  kt/T]  -  (l+k)u(t-T)  -  ^  (t-T)u(t-T) 


+  ku(t-2T)  +  -  (t-2T)u(t-2T) 
T 


=  u(t)  [l  +  kt/T]  -  u(t-T)  [(1+k)  +  ~  (t-T)] 


u(t-2T)  [ 


k  +  k 


t-2T, 
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Taking  the  Laplace  transform, 


which  can  be  written  in  the  form 


H^{s)  =  (1  -  ke-T^)  ^  [(s.l/T)  (i 

=  (1  -  ke-TS)  H^(s)  +  ^  H^(s) 


The  frequency  response  for  this  fracxional-order  hold 
is  shown  in  Figure  14(b),  and  is  given  by 

|H^(jco)l  = 
where 

R(x,k)  =  1  +  -  2k  cos  2x  +  ^  -  2  cos  x) 


4-  2k  sin  X  cos  x 

X 


and 


/H,  {j(o)  =  -  2x  +  tan-1  f - x, - - 1 

4...  . —  L/,  .  \  ,  sin  xJ 


(l-k)  cos  X  4-  k 


X 
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The  realization  of  this  k^^-order  hold  follows  from 
the  definition  of  its  operation  and  the  first-order  hold  of 
Figure  7(e).  It  is  shown  in  Figure  14(c). 

Notice  that  this  requires  no  more  amplifiers  than  the 
first-order  filter,  which  it  becomes  when  k  =  1. 

6.2  Exponential  Reconstruction  Filters 

The  polynomial  filters  considered  in  the  previous 
sections  are  not  the  only  realizable  reconstruction  filters 
possible;  it  is  also  possible  to  approach  this  filter  design 
by  more  conventional  means.  The  following  considers  the 
problem  depicted  in  Figure  A2,  where  the  output  of  the  D/A 
converter  is  fed  to  an  exponential  filter  (i.e.,  possessing 
a  finite  number  of  poles).  Two  cases  are  considered,  the 
first-order  case  and  the  second-order  case. 

6.2.1  First-Order  Exponential 

Let  H(s)  be  a  first-order  lag  with  cut-off  frequency 

b ,  i.e.. 


H(s) 


b 

s+b 


The  reconstruction  filter  will  have  the  transfer 

function 


(30) 


The  frequency  response,  plotted  in  Figure  15,  is 
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given  by 


where  x  =  -^  as  before,  and  where 

K  =  - - - 

(“5/2) 


6.2.2  Second“Order  Exponential 

For  H(s)  second-order,  the  reconstruction  filter 
will  have  the  transfer  function 


The  frequency  response  is  given  by 


where 
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(»g/2) 


This  is  plotted  in  Figures  16(a)  to  (d)  for  various  va]"es  of 
C  and 


'n 


(“s/2)‘ 


7.0  DISCUSSION  OF  FREQUENCY  CHARACTERISTICS 

As  discussed  in  Sections  3,3  and  3.4,  it  is  the  task 
of  the  recovery  filter  to  separate  the  signal  contained  in  the 
frequency  interval  -  co  /2  <  co  <  (0  /2  from  the  sampling  side- 
bands  centred  at  frequencies  for  all  non-zero  integer  k. 
Ideally,  the  amplitude  response  of  the  filter  should  be  unity 
for  as  large  a  frequency  interval  as  possible  near  zero,  and 
should  be  as  near  zero  as  possible  for  an  equivalent  frequency 
interval  about  the  sideband  center  frequencies.  The  desired 
phase  response  of  the  filter  will  depend  on  whether  or  not  a 
time  lag  in  the  recovery  operation  can  be  tolerated.  If  the 
phase  response  increases  linearly  with  frequency  over  the 
above-mentioned  frequency  interval,  then  phase  distortion  will 
be  absent,  and  the  signal  is  recovered  delayed  in  time  by  a 
value  equal  to  the  phase  slope.  Obviously  any  closed-loop  or 
otherwise  real  time  situation  would  be  affected  by  this  delay, 
whereas  open-loop  signal  recovery  would  not. 


It  is  evident,  from  the  frequency  responses  presented, 
that  the  choice  of  a  suitable  recovery  filter  is  a  task  which 
depends  critically  on  the  frequency  content  of  the  signal  being 
recovered,  as  well  as  on  the  system  in  which  the  filter  is  to 
appear;  even  complexity  does  not  allow  for  any  "better"  or  "best" 
choice.  However,  a  number  of  general  comments  can  be  made. 

Consider  the  zero-,  first-  and  second-order  filter 
of  Figures  6(c),  7(c)  and  ll(b),  the  significant  features  of 
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which  are  summarized  and  compared  in  Figure  17.  In  general, 
an  increase  in  complexity  yields  a  better  approximation  to  the 
ideal  only  at  very  low  frequencies,  and  results  in  increased 
departure  from  the  ideal  at  the  higher  frequencies.  Of  special 
note  are  the  avoidance  of  delay  near  zero  frequency  for  the 
first-  and  second-order  filters  (at  the  expense  of  phase  dis¬ 
tortion),  and  the  increased  attenuation  of  the  sidebands  (again 
for  low  frequencies). 

The  fractional-order  hold  of  Figure  14(b)  illustrates 
how  a  compromise  between  the  zero-  and  first-order  filters  yields 
a  more  satisfactory  amplitude  response  to  a  significantly  higher 
frequency.  This  is  achieved  at  the  expense  of  decreasing  the 
sideband  attenuation  over  that  possible  with  the  first-order 
case,  and  the  introduction  of  both  phase  distortion  and  delay 
at  all  frequencies. 

The  first-order  smoothed  filter,  as  expected,  increases 
the  attenuation  of  the  sidebands  at  the  expense  of  delay  and 
increased  distortion  for  higher  frequencies.  The  first-order 
ideal  and  first-order  delayed  markedly  decrease  the  sideband 
contributions  at  the  expense  of  delay  (for  the  delayed  case) 
but  without  phase  distortion. 

The  first-order  exponential  seems  to  have  little  to 
recommend  it.  It  decreases  the  bandwidth,  for  a  given  amplitude 
error,  over  the  zero-order  case,  and  also  increases  delay  and 
adds  phase  distortion.  Its  only  advantage  is  the  increased 
attenuation  of  the  sidebands. 

The  second-order  exponential  of  Figures  16(a)  to  (d) 
is  much  more  interesting.  The  presence  of  the  under-damped 
filter  compensates  for  the  droop  in  the  zero-order  frequency 
response  to  extend  the  bandwidth  for  a  given  amplitude  error. 
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This  is  done  at  the  expense  of  increased  phase  lag,  which  is 
in  the  form  of  increased  delay  at  zero  frequency  over  that  of 
the  zero-order  case,  as  well  as  the  presence  of  phase  distor¬ 
tion.  The  sidebands  are  markedly  attenuated,  the  attenuation 
increasing,  as  expected,  as  the  resonant  frequency  of  the 
filter  is  decreased.  This  reduction  of  resonant  frequency, 
however,  decreases  the  bandwidth  of  the  filter, 

8.0  ROOT  MEAN  SQUARE  RECOVERY  ERROR  OF  FILTERS 

One  of  the  conclusions  of  the  previous  sections  can 
only  be  that  the  frequency  response  characteristics  of  the 
reconstruction  filters  are  rather  difficult  to  interpret  in 
any  general  way.  Typically,  the  requirements  for  undistorted 
transmission  near  zero  frequency  (i.e.  low  amplitude,  phase 
distortion  and  delay)  conflict  with  the  requirements  for 
attenuation  of  the  sideband  components.  Choosing  the  re¬ 
construction  filter  on  the  basis  of  these  frequency  response 
curves  alone  would  necessarily  depend  greatly  on  the  details 
of  the  problem  in  hand,  where  the  relative  demerits  of  errors 
in  the  various  frequency  intervals  would  have  to  be  assigned. 
There  is  an  obvious  need  for  a  more  analytic  filter  rating 
procedure . 

One  can  attempt  this  more  rational  filter  rating  by 

proceeding  along  the  lines  suggested  in  Section  4,  where  the 

reconstruction  error,  e  (t),  was  defined.  Assume  that  the 

c 

digital  signal  fed  to  the  recovery  filter  is  the  sampled 
version  of  the  signal  which  is  to  be  recovered.  The  difference 
between  this  signal  before  sampling,  and  the  recovery  filter 
output,  is  directly,  then,  the  reconstruction  error  for  the 
filter.  This  is  illustrated  in  Figure  18.  It  remains  to 
choose  the  recovery  filter  such  that,  for  a  given  f(t),  there 
is  an  acceptable  reconstruction  error  e{t). 
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Although  many  measures  of  reconstruction  error  are 
possible,  e.g.  maximum  error,  mean  error,  etc.,  each  of  which 
might  be  appropriate  in  given  circumstances,  the  root  mean 
square  value  of  this  reconstruction  error  will  be  considered 
here. 

In  the  discussions  that  follow,  time  is  measured  by 
the  relation 

t  =  (rT<-p)T  (32) 

where  T  =  sample  interval,  seconds 
n  =  integer 

p  =  intersample  parameter,  where  0  ^  p  <  1 
and  the  following  notation  is  introduced: 

g(t)  =  g  [(n+p)T]  =  g^^p  (33) 

Using  (32)  and  (33),  tlie  reconstruction  error  from 
Figure  18  is  given  by 

e  ,  =  q  -  f 

n+p  ^n+p  n+p 

tor  0  ^  p  <  1  and  all  integers  n. 

Let  the  input  be  a  complex  sinusoid  of  frequency  o), 

then 

f(t)  = 

n+p 


or 


Let 


then 


and 


will  be 


e^(t)  = 


where 
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0)7  =  a 


rt*-p 


^rt<-p  ■  9n+p  •  ® 


Jan  .  oJpa 


(34) 


The  mean  square  value  of  this  reconstruction  error 


T 

lim  ^  J  e2(t)dt 

T-^00.  Q 

NT 

lim  J  e^(t)clt 

N’^00  0 

T  2T  NT 

lim  nf{j£^{t)dt+  J  e^(t)dt  +  ...+  J 

N-^oo  ^0  T  (N-l)T 

N-1  (rH-l)T 

lim  J  e^{t)at. 

n=0  nT 


In  the  n 


th 


interval , 


e 


2 

n+p 


t  =  ( n+  p )  T 


dt  =  Tdp 


and 
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) 


thus, 


e2{t)  =  llm  i  i  J  e^pdp 

N"^oo  n=0  0 


or,  in  more  synunetric  form, 


t)  =  lim  —  Y  dp 

N“^oo  n=0  0 


(35) 


For  this  complex  sinusoidal  input  the  recovery  error 
will  be  of  the  form 

e^p  =  A(p)e'^^'^  (36) 

Thus,  for  the  real  input  f(t)  =  cos  cot,  the  recovery  error, 
e(t) ,  will  be 


e  - 

n+p  2 


where  is  the  complex  conjugate  of 


Thus , 


2  /  *  ^2  * 
n+p  4  4  2 


2 

e  ^ 
n+p 


[A{p)]2 


Now 
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Since 


[a(p)]^  ^  exists, 


then  it  follows  that 


Similarly, 


N 

y*  J  ^ 

Nfl  ^  i  n+p  ^ 


N‘^00 


fO  0 


N  1 

y  J  " 

f^l  L  J  n+p  ^ 

N"*"©©  n=0  0 


e  .  e 


=  Kp) 


(37) 


Since  l(p)  is  independent  of  n,  then  the  mean  square  recovery 
error  for  the  cosine  input  will  be 


.^(t)  =  J  i(p)dp 

0 


(38) 


In  the  sections  following,  this  mean  square  re¬ 
construction  error  for  a  unit  cosinusoidal  input  is  determined, 
and  the  percent  root  mean  square  value  is  plotted  for  each  as  a 
function  of  input  frequency.  The  root  mean  square  is  defined  by; 

Percent  r.m.s.  error  =V  e'^(t)  x  100 

2 

where  e  (t)  is  given  by  equation  (38)  for  a  unit  amplitude 
cosine  input. 
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In  the  majority  of  the  cases  considered,  the  root 
mean  square  value  of  the  reconstruction  error  was  also  determined 
experimentally,  using  standard  analog  computer  components.  The 
experimental  errors  are  mainly  due  to  the  difficulty  in  simulat¬ 
ing  the  digital  features  of  the  filters  with  the  equipment  at 
hand,  and  the  difficulty  of  measuring  the  mean  square  value  of 
slowly  varying  signals. 

8.1  Root  Mean  Square  Error  -  Zero-Order  Filter 


For  the  zero-order  filter,  the  intersample  signal  is 


given  by 


^n+p  ”  ^n 

and  the  recovery  error,  for  the  complex  sinusoid  input,  by 


^n+p  "  ^n+p  ”  ^n+p 


"  ^n  "  ^n+p 
=  _  ^jan  .  jap 


=  eJ-{l  -  eJ^P) 

This  is  of  the  form  of  equation  (36),  and  so  one  forms 


i(p)  = 


=  1/2  -  ej^P)]  •  -  e'j^P)] 

=  1/2  (1  -  ej^P  -  e'j^P  +  1) 


=  (l  -  cos  ap) 


(t)  =  J  i(p)dp  =  1  -  ^ 


in  a 
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Substituting  for  a,  the  mean  square  error  is  given  by 


e2(t)  =  (l 


sin  (nTs 
ojT  ^ 


(39) 


The  percent  root  mean  square  value  of  equation  (39) 
for  a  unit  amplitu(ie  cosinusoidal  input  is  plotted  in  Figure  19 
as  a  function  of  Y  =  samples  per  cycle 


where 


Y  = 


2n 

0)1 


Of  interest  is  the  behaviour  of  the  mean  square  error 
for  small  (o)T),  or  large  samples  per  cycle*  This  is  obtained 
from  (39)  and  is  given  by 


e2(t) 


r(toT)^  (uiT)'^  ^  (oiT)^  +  I 
16  "120  5040  " 


8.2  Root  Mean  Square  Error  -  First-Order  Extrapolator 
Unsmoothed _ 


The  intersample  behaviour,  from  Section  5.2.1,  is 

given  by 


Vp  =  -  P^n-1 


The  recovery  error  for  the  input  e-^^^  is 


Vp=  ni-p)  -  pe-^^  -  e^^P] 


Forming  I (p) , 


l(p)  =  (1+p+p  )  -  p(l+p)  cos  a  -  (l  -  cos  a)p  cos 


pa 


-  (sin  a)p  sin  pa  -  cos  pa 
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The  mean  square  error  becomes 


=  pi  -  5  COSO)!  __  2(1  -  coscoT) 
^  6 


(coscoT  coT  sintoT) 
(toT)2 


(40) 


and  the  percent  root  mean  square  value  of  this  is  plotted  in 
Figure  19. 

For  small  or  many  samples  per  cycle,  this 

becomes 


1061(0)1)^  ^ 
(84) (720) 


»  [0.12916  (a)T)‘*  -  0.017543  ((OT)^  +  ...] 


8.3  Mean  Square  Error  -  First-Order  Extrapolator  -  Smoothed 

For  the  smoothed  linear  extrapolator,  the  mean  square 
error  becomes 


_  f/'lS  cosa)T 

®  <*)  -  Kt  -  ~2— 


2  cos  0) 


2  q 

2 (l+cosa)T-4cos  60T-4-2COS  (0 
(aiT)^ 


lij 


which  is  plotted  in  Figure  19. 

For  small  (coT)  this  becomes 


e^(t) 


'101  (uiT)'*  _  11342(mT)^  ^ 
-  240  '  (720) (147) 


[0.42083  (toT)^  -  0.107162  (ojT)^  +  ...] 
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For  small  (coT)  this  becomes; 


I*) = ® 


11  (cot) °  ^  . 

(84)  (720)  '(56)  (90)  (720) 


13  (cot) 


8 


-  + 


...] 


=  [0.83333  (cot)'*  -  0.036375  (coT)^  +  0.0007165  (coT)®  +  ...] 


8.6  Mean  Square  Error  -  Second-Order  Extrapolator 

From  Section  5.3.1,  the  second-order  intersample 
response  is  given  by 


Wp 


_  (  n  n-1  n-4^A 

V  2  ^ 


.3f  -4f_  ,+  f 


p  - 


For  f(t)  =  the  above  results  in  a  recovery 

error  given  by 


=  [A  -  Be“J"  +  Ce“2J3  -  e^^P]  e^ 


na 


where 


a  =  0)1  as  before, 


and  where 


A  = 


P  3  p  +  2 
2 


-  ^2 


-  R. 


P  +  2p 
2 


+ 


Again,  this  is  in  the  form  of  equation  (36),  and  one 
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forms,  for  a  cosine  input,  the  expression 

I(p)  =  .-rtP.lL  =  (3e!  .  3p3  +  ^  ^  l) 

2  4  4  2 

-  (cos  a)  (p^+4p^+5p^+2p)  +  cos  2a  ^ ^ 

V  4  X 

-  cos  ap  cos  [(p+l)a]  (p^+2p) 

-  cos  [(pf2)a] 

Integrating  over  the  intersample  parameter  p,  the  mean  square 
recovery  error  for  a  cosine  input  becomes 

"7777  44  58  cos  a'N  .  3  sin  a  -  3  sin  2a  +  sin  3a 

e^(t;  =  —  — ^  cos  a  I  1  -  - )  +  - r - 

15  15  ^  2  ^  a3 

+  3(1  -  3  cos  a  +  3  cos  2a  -  cos  3a) 

2a2 

(“  3  sin  a  +  3  sin  2a  -  sin  3a) 
a 

the  root  mean  square  value  of  which  is  plotted  in  Figure  20. 

y 

Again,  for  small  a  =  (coT),  this  reduces  to 


e2(t)  .  riOiloillZ  ,  . 1 

945 


8.7  Mean  Square  Error  -  Second-Order  -  Unit  Delay 

By  a  similar  procedure,  the  mean  square  error 


I 
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becomes 


1  ^3  cos  a  -  3  cos  2a  +  cos  3a  -I 

“  - 75 - 


3  sin  a  -  3  sin  2a  +  sin  3a 


which  is  plotted  in  Figure  20. 

For  small  (coT)  =  a,  this  becomes 


.2/.^  ((oT)^  577{o)T)^  , 

e  (t)  -  (115^)1^7)  +  .... 


8.8  Mean  Square  Error  ~  Second-Order  -  Ideal 

In  the  case  where  delay  can  be  tolerated  and  its 
effect  neglected,  the  mean  square  error  becomes 


e2(t) 


14  2 

—  +  ~  cos 

15  15 


cos  Ci)T\  2  sin  coT  ^1  -  cos  coTN 
2  (coT)2  ^  <oT  ^ 


COS  CO 


coT 


-0 


2 


45 


which  is  plotted  in  Figure  20. 
For  small  (coT) 


•  #  •  • 
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8*9  Mean  Square  Error  -  Fractional-Order  Hold 
The  mean  square  error  is  given  by 

e^(t)  =  1  +  (•!y  +  D  (1  -  cos  a>T)  -  (l  -  k  cos  wT) 

- (1  -  cos  (oT)(2  cos  (dT  +  (oT  sin  coT) 

(aT)'^ 

This  is  plotted  in  Figure  21  for  various  values  of  k« 

For  small  (coT),  this  behaves  as 

(1 .  k)2. .... 

6 

8*10  Mean  Square  Error  ••  First-Order  Exponential 

The  calculation  of  mean  square  error  for  the  exponential 
filters  requires  a  different  technique,  and  is  discussed  in 
Appendix  A,  There  results,  for  the  first-order  case, 

e^(t)  =  1  -  +  (sin  (oT  -  bT  cos  coT  +  bT) 

((oT)2  +  (bT)2 

(1  -  e~2^^)(l  -  cos  ml) 

2bT(l  -  2e"^^  cos  (oT  + 

This  is  plo.tted  in  Figure  22  for  values  of 

K  =  b/((Og/2) 
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8.11  Mean  Square  Error  -  Second-Order  Exponential 

Again,  from  Appendix  A,  the  mean  square  error  is 
shown  to  be 

_ _  1  .  ‘ 

e^(t)  =  J  I(p)dp 
0 

where 

Kp)  =  1/2  [l  + 

N(p)  =  -  2  cos  ap  (R  -  SZ  +  UA^) 

+  •2  COS  a  (RS  +  SU)  -  2  cos  [a(l+p)]  (S  -  UZ) 

+  2RU  cos  2a  -  2u  cos  [a{2+p)] 

+  2  cos  [(l-p)a]  (RZ  -  A^S)  -  2A^R  cos  [(2-p)a] 

D  =  (1  +  +  a"^)  -  2  cos  a  (Z^  +  ZA^)  +  2P?  cos  2a 

R  =  (1  -  YW) 

S  =  (X  +  YW  -  Z) 

U  =  (A^  -  YX) 

W  =  cos  (bpT  + 

X  =  A  cos  <(l-p)bT  -  i6> 

Y  ~  A^  sec 
Z  =  2A  cos  bT 
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tan  =  -  r 

D 

d  =  C»n 
b  =  60  tjl  - 
a  =  6oT 

This  was  evaluated  digitally,  and  the  resulting  root  mean  square 
value  plotted  in  Figures  23(a)  to  23(c)  for  various  values  of 

and  C 


There  are  perhaps  two  general  comments  which  can  be 
made  about  the  root  mean  square  recovery  error  plots  of  Figures 
19  to  23.  First,  for  more  than  approximately  five  samples  per 
cycle  of  input  frequency,  increasing  the  polynomial  filter  order 
results  in  a  reduction  of  root  mean  square  recovery  error.  And 
second,  the  more  traditional  exponential  filters  yield  a  root 
mean  square  recovery  error  which  is  always  greater  than  that 
available  by  using  the  raw  staircase  output  directly. 

One  must  remember,  however,  that  the  above  comments 
are  pertinent  only  if  the  root  mean  square  recovery  error  is 
a  valid  error  measure  for  the  case  in  hand.  The  polynomial 
filters  will  usually  allow  discontinuities  at  the  sample 
instants,  as  does  the  zero-order  hold  itself,  whereas  the 
exponential  filters  provide  a  great  deal  of  smoothing  of  the 
response.  This  smoothing,  however,  is  achieved  at  the  cost 
of  delay,  which  is  seen  to  result  in  the  larger  root  mean 
square  recovery  errors. 
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10.0  CONCLUSIONS 

This  report  is  essentially  divided  into  two  main 
sections.  In  the  first,  a  review  of  certain  topics  from  the 
theory  of  sampled-data  systems  is  presented,  which,  in  the 
opinion  of  the  author,  is  more  intuitively  satisfying  than 
that  available  elsewhere.  This  section  also  contains  an 
analysis  of  the  sources  of  error  occurring  in  sampled-data 
systems  containing  a  digital  device.  Here  it  is  shown  that 
errors  in  such  systems  arise  from  two  main  processes.  The 
first,  a  digital  error,  is  due  to  the  numerical  approximations 
made  in  the  digital  process  used,  and  the  second,  a  reconstruc¬ 
tion  error,  is  due  to  the  recovery  process  necessary  to  convert 
the  digital  signals  to  continuous  form. 

The  main  body  of  the  report  is  devoted  to  a  detailed 
evaluation  of  the  reconstruction  errors  arising  from  realizable 
digital-to-analog  conversion  processes.  It  is  assumed  that  the 
required  conversion  is  achieved  in  two  steps;  first  the  digital 
data  is  converted  to  a  staircase  signal  by  a  conventional 
digital-to-analog  converter,  and  this  staircase  signal  is  next 
smoothed  by  a  realizable  smoothing  filter.  Two  families  of 
smoothing  filters  are  considered,  the  finite  memory  polynomial 
filters,  and  the  more  conventional  infinite  memory  exponential 
filters.  Circuits  are  presented  which  allow  the  filters  to  be 
realized  using  standard  analog  computing  components. 

The  first  comparison  between  the  various  digital- 
to-analog  conversion  processes  is  made  on  the  basis  of  their 
frequency  response  characteristics.  It  is  shown  that  such  a 
comparison  does  not  lead  to  an  analytic  evaluation,  and  it  be¬ 
comes  a  difficult  design  task  to  choose  from  among  the  possible 
solutions.  The  frequency  response  curves  do,  nonetheless,  allow 
certain  general  comments  to  be  made  as  to  the  types  of  distor¬ 
tions  present,  such  as  phase  and  amplitude  errors,  ripple 


Page'-  5T«  ^ 

MK-12  » 

attenuation,  etc.,  and  should  be  considered  if  certain  of  these 
types  of  error  are  especially  important. 

Lastly,  a  comparison  based  on  the  root  mean  square 
recovery  error  is  presented.  This  error  is  obtained  when  the 
digital  data  to  be  converted  are  samples  of  a  sinusoid  of 
varying  frequency,  and  the  resulting  output  is  compared  with 
this  sinusoid  to  form  the  recovery  error.  The  curves  presented 
show  the  improvement  to  be  expected  when  the  higher  order 
smoothing  filters  are  used,  and  can  be  used  directly  for  design 
purposes  when  the  root  mean  square  error  is  a  suitable  design 
criterion. 
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APPENDIX  A 


In  the  case  where  the  staircase  output  of  the  D/A 
converter  is  fed  to  an  exponential  filter  which  has  a  non- 
finite  transient  response,  the  simple  method  used  to  obtain 
the  filter  output  for  the  polynomial  filters  cannot  be  used. 

The  system  of  interest  is  obtained  from  Figure  18,  and  shown 
in  Figure  A-1.  The  system  is  seen  to  be  a  sampled-data  system, 
and  z-transform  techniques  can  be  used  (see  Ref.  1,  2,  3  or  4). 

The  modified  z-transform  of  the  output  g(t)  will  be 
G(z,nti)  =  (^)  •  F(z)Z^  (A.l) 

which  yields  a  recovery  error  whose  modified  z-transform  is 

E(z,m)  =  (^)  F(z)  •  -  F(z,tn)  (A. 2) 

Now  the  mean  square  recovery  error  is,  from  Section  8, 

given  by 

_  N  1 

e^(t)  =  lim  -i-  y  [  dp  (A. 3) 

1^1  Z.  J  n+p 

N-^-oo  Pi=0  0 

It  is  thus  required  to  take  the  inverse  modified 
2-transform  of  (a.2)  and  substitute  into  (A. 3).  The  inverse 
modified  z-transform  is  given  by 

e(n,m)  =  +  |  E  ( z  ,m)  z‘^"-*-dz 

n-i+m  27rj  ^ 


EXPONENTIAL  FILTERING  OF  D/A  CONVERTED  DATA 


where 
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W  =  1  -  B™  -  a"" 

X  =  B  +  s'"  -  A^B 

and  where  m  =  p 

.  =  ^  ^  -JUl^  .  z"dz 

n+p  2Trj  J  (z-A)  (z-B) 

=  WA  -  X  ,  ^  WB  -  X  gn 

A  -  B  B  -  A 

Now  B^  -♦  0  as  n  increases,  and  so  has  a  mean  square 
value  of  zero.  Tnus  the  only  contribution  to  the  mean  square  , 
will  be 


WA  -  X 
A  -  B 


giver  by 


Again  the  mean  square  error  for  a  cosine  input  is 


where 


1 

* 

e2(t)  =  J 

6  0 

-atj>._D^p  dp  = 

2 

0 

I(p)  =  1 

I^WA  -  X\  ^W*A* 

V  A  -  B-^  V  A* 

Now 

(1  -  2B  cos  a+B^)  l(p)  =  l-B^+B^P+B^+BB^  -  cos  a[2B-BBP-BP+B^P] 

-  cos  ap[l-BP+B^-BBP] 

+  cos  a(p+l)  [B-bP] 


+  cos  a(p-l)  [B-B^^P] 
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Integrating  over  the  p,  and  after  some  effort,  the 
mean  square  error  becomesi 


sin  a  .  sin  a-Pcos  a•^3 

=  a2  .  p2 


(1  -  B^)(l  .  cos  a) 
2P(1  -  2B  cos  a  +  B^) 


where  a  =  cdT 
P  =  bT 


Case  2i  Second-Order  Filtering 


Let 


H(s)  = 


0) 


n 


s  +  0)  ^ 
^  n  n 


z  jnhl]  z  I  - ^ 


=  Z 


^s[  ( s+d)^  + 


m 


where 


d 


n 


Then 


7  rH(s)-|  .  I_i_  _  .  rz  cos(bmT+^)  -  A  cos<(l-m)bT-/!<>1  1 

ral  s  J  lz-1  L  ut^a2  -JJ 

z  -  2z  A  cos  bT  +  A 
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where 


A  =  e-'lT  =  e-’^"nT 


d  C 

and  tan  =  -  -  =  -  - ^ 


a/TTc? 


Now  F(z)  = 


z 


z-C 


where  C  =  e 


= 


The  filter  output  is  thus 


C(z,ra)  =  (^)  (■^)  {7^  -  a""  sec  f( 

r z  cos(bmT^-jrf)  -  A  cos<(l-m)bT"/rf>'1  i 
z^  -  2zA  cos  bT  +  A  ^ 

Again  it  is  the  contribution  from  the  pole  at  z  =  C 
which  yields  the  steady-state  component  of  the  output  and  which 
has  the  non-vanishing  mean  square  value.  This  component  is 
given  by 

vp  =  [‘  -  (4  ” : :  .i}]  <=“ 


where  W  =  cos(bpT  +  fS) 

X  =  A  cos<(l-p)bT-/i> 
Y  =  A*^  sec  ^ 

Z  =  2A  cos  bT 


I 


The  recovery  error  becomes 


CONVCKTCKt 


A/0  D/A  8TAIRCAK 


FIGAI  EXPONENTIAL  FILTERING 


FI6.A2 


EXPONENTIAL  RECONSTRUCTION 
FILTERS 
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APPENDIX  B 


HARDWARE  REQUIREMENTS  FOR  FILTERS 

Another  comparison  of  the  recovery  filters  is 
obviously  the  hardware  necessary  to  realize  these  filters. 

Table  B-1  provides  one  such  comparison  based  on  realizing  the 
filters  with  standard  analog  computer  components.  It  is  assumed 
that  a  sample  and  hold  amplifier  is  available  for  the  polynomial 
recovery  filters,  and  that  the  filters  receive,  as  an  input,  the 
staircase  output  of  a  conventional  digital-to-analog  converter. 
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TABLE  B-1 


Filter 

No.  of  Amplifiers 

Circuit  Diagram 
Figure  Number 

Zero-Order 

None  or  one 

6(b) 

First-Order 
Extrapolator  - 
Unsmoothed 

5 

7(e) 

First-Order 
Extrapolator  - 
Smoothed 

7 

8(e) 

First-Order 

Delayed  and 

Ideal 

3 

9(d) 

Second-Order 

Extrapolator 

7 

11(d) 

Second-Order 

Delayed  and 

Ideal 

7 

12(c) 

N^^-Order 

Extrapolator 

N  +  4 

plus  inverters 

13 

First-Order 

Exponential 

1 

Second-Order 

Exponential 


3 
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HARDWARE  REQUIREMENTS  FOR  FILTERS 

Another  comparison  of  the  recovery  filters  is 
obviously  the  hardware  necessary  to  realize  these  filters. 

Table  B-1  provides  one  such  comparison  based  on  realizing  the 
filters  with  standard  analog  computer  components.  It  is  assumed 
that  a  sample  and  hold  amplifier  is  available  for  the  polynomial 
recovery  filters,  and  that  the  filters  receive,  as  an  input,  the 
staircase  output  of  a  conventional  digital-to-analog  converter. 
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